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This initial issue describes the development, organization, staff, and facilities of 
the EPIC (Evaluative Programs for Innovative Curriculums) Evaluation Center, a 
cooperative effort of the U.S. Office of Education (under Title III of the Elementary 
and Secondary Education Ac.), the University of Arizona (College of Education), and 
the public and nonpublic schools of Arizona. Introductory sections trace the historical 
background and philosophy of the Center, which began in 1967 to provide 
educational agencies with technical assistance, facilities, and fnservice training 
programs necessary for them to assess their current and innovative instructional 
programs. The mafor section describes the organization of the Center (under a 
director responsible to a board of directors) and the responsibilities of each of the 
two divisions: the Field Services Division, which established and maintains contact with 
school districts requesting Center services, and the Evaluation Services Division, which 
(1) provides technical assistance for the selection of treatments, measurement 
instruments, evaluation designs and statistical analyses: (2) processes data: and (3) 
reports the results of the evaluation process. Job responsibilities are outlined for 
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EPIC EVALUATION CENTER 
1034 East Adams 
Tucson, Arizona 



Established Julyl, 1967, the EPIC Evaluation Center is sup- 
ported by the U.S. Office of Education under the Elementary and 
Secondary Education Act of 1965, P. L. 89-10, Title HI. Although 
it is federally funded, the Center basically functions as a regional 
evaluation center with its control, leadership, and services guided 
by the educational needs of the region it serves. 
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PREFACE 

The EPIC Evaluation Center represents a unique cooperative' effort with 
tho U. S. Office of Education, The University of Arizona (College of Educa- 
tion), and the public and non-public schools of Arizona to produce an exem- 
plary innovative approach to the problem of evaluation. 

The creation and development of a center for the purpose of providing 
educational agencies with the technical assistance and facilities necessary 
to develop and maintain sound and continuous programs of evaluation re- 
sulted from a year of intensive planning by a team of educators. As EPIC 
progressed through its initial year of operation (1967-68) a center concept 
was implemented, evaluated, and refined. The purpose of this initial issue 
of the EPIC BRIEF is to describe the development, organization, staff, and 
facilities of the EPIC Evaluation Center. 
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HISTORICAL OVERVIEW AND DEVELOPMENT 
OF THE EPIC EVALUATION CENTER 



The need for a systematic approach to the evaluation of innovations has be- 
come one of education's most pressing problems. Only by systematic evalua- 
tion can education avoid the fads, pressures , pendulum-swingings of educational 
practice and address itself to the basic question concerning an educational in- 
novation: Is it really effective in achieving its expressed objectives? 



Title III of the Elementary and Secondary Education Act of 1965 placed high 
priority on the funding of innovative and exemplary education programs. Public 
and private schools have been given the responsibility, through Federal support, 
for utilizing knowledge and ideas from research. In addition to this application 
ot knowledge through research, comes the request for programs designed to 
share information relating to the strengths and weaknesses of the innovations 
derived from research. This use in sharing new ideas requires effective pro- 
cedures for appraising and reporting the results of attempts made by those 
educational agencies that have accepted the challenge for change. 



The EPIC Evaluation Center, created to meet this challenge, has attempted 
to produce an innovative and exemplary approach to the problem of evaluating 
instruchona 1 programs. EPIC represents an approach to evaluation created 
through a structure and scheme for the analysis of variables acting on a given 
innovation or program, and a Center to provide the facilities and services nec- 
essary to apply the program. The courage to try new programs requires the 
support of appropriate technical assistance and facilities. 



The EPIC Evaluation Center became operational on July 1, 1967, following 
a year of intensive study by a team of educators representing various disci- 
plines. The results of the previous year's planning were incorporated during 
the initial operational year (1967-68). The EPIC Structure and Scheme for 
Evaluation were applied to the instructional programs of selected elementary 
and secondary schools in Arizona. Thus, a proposal that began with an inno- 
vative approach to evaluation evolved into a practical and functional approach. 
Various modifications in organization and procedures have taken olace since 

f. PI S^. C ° nCepti ° n: however * at present (1968-69) it is practical to describe 
the EPIC Evaluation Center as truly an exemplary approach to the problem of 
evaluation. F 



Figure 1 describes the stages in the development of the EPIC Evaluation 
Center. 



PHILOSOPHY OF THE EPIC EVALUATION CENTER 



The EPIC staff believes that many school districts seek aid in the form 
of evaluation tools and personnel to adequately assess their current and inno- 
vative instructional programs. Applying evaluation to the classroom requires 
technical assistance, hardware, and in-service training programs beyond the 
resources of most school districts. The primary purpose of the EPIC Evalu- 
ation Center is to assist schools in the evaluation process and in the design 
of appropriate evaluation techniques. EPIC does not function as an outside 
evaluation agency, but operates on the principle that evaluation must be a prod- 
uct of local schools. Evaluation service agencies should work only as con- 
sultants in developing and strengthening skills required by professional edu- 
cators to successfully accomplish the task of assessment. EPIC is a service 
agency staffed, structured, and equipped to aid educators in answering the 
ever-present question': "How well are we doing our jobs?" 
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FIGURE 1 

DEVELOPMENT OF THE EPIC EVALUATION CENTER 
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ORGANIZATION OF THE EPIC EVALUATION CENTER 

The EPIC Evaluation Center is responsible to its Board of Directors, whose 
members represent the Arizona educational agencies and school districts which 
supported the initial application for funding under Title III of the Elementary 
and Secondary Education Act of 1965--Ajo Public Schools, Amphitheater Public 
Schools, Buena Public Schools, Catalina Foothills Schools, College of Educa- 
tion (The University of Arizona), Flowing Wells Public Schools, Marana Pub- 
lic Schools, Nogales Public Schools, Patagonia Union High School, Pima County 
Public Schools, Sahuarita Public Schools, San Manuel Public Schools, Sells 
Public Schools, State Department of Public Instruction, Sunnyside Public Schools, 
Tucson Diocesan Catholic Schools, and the Tucson District fl Public Schools. 

General supervision of the activities of the EPIC Evaluation Center is the 
responsibility of the Director. In addition to maintaining close contact with 
the involvement of EPIC in assisting schools and agencies in evaluation pro- 
grams, an important responsibility of the Director is to develop and maintain 
liaison with the state and national level agencies concerned with EPIC T s pro- 
gress. 

The Assistant Director and Division Coordinators (Evaluation Services and 
Field Services) assume administrative responsibilities, as well as assisting the 
Director in the formulation of policies and procedures relating to the day-to- 
day operation of the Center. The Organizational Structure of the EPIC Eval- 
uation Center is shown in Figure 2 (page 4). 

Other administrative and operational procedures, as well as overall devel- 
opment and planning, are the responsibilities of the committees within the 
Center. The specific responsibilities and membership of each committee are 
described in the EPIC Policy and Procedure Manual . Figure 3 explains the 
EPIC Committee Structure. 



FIGURE 3 

EPIC COMMITTEE STRUCTURE 
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THE TWO DIVISIONS OF THE EPIC EVALUATION CENTER 

The Field Services Division, and Evaluation Services Division are the two 
major Divisions of the EPIC Evaluation Center. While each Division has many 
distinct responsibilities, there are many activities and functions undertaken by 
the Center in which the two Divisions complement each other. The Coordinator 
of each Division is responsible for the operation of his respective Division and 
is in turn responsible to the Director of EPIC. 

i Figure 4 (page 6) presents the major functions of the Field Services and 

Evaluation Services Divisions of the EPIC Evaluation Center. The two Divi- 
sions are discussed in some detail in the following pages 
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FIELD SERVICES DIVISION 





INTRODUCTION 

The Field Services Division is under the direct supervision of its Coor- 
dinator. The staff of the Field Services Division currently has five Field 
Service Representatives and one Field Service Assistant. 

The primary function of this Division is to establish and maintain contact 
with those school programs requesting the services of the EPIC Evaluation 
Center. After a request for service is received by the Center, the first con- 
tact with personnel of the program is usually made by a Field Service Rep- 
lesentative, at which time the initial interview and on-site survey are conducted. 
The purpose of this interview and survey is to gather pertinent information de- 
scribing the program. During the initial interview, information is gathered 
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concerning the origin and background of the program, A brief written descrip- 
tion of the program, personnel involved, and other pertinent information which 
will assist the Center in initiating evaluative procedures are also obtained at 
this time. The Field Service Representative is the communications link be- 
tween the Center, the teachers, and administrators in the field. This contact 
is maintained by personal visits, telephone conversations, and letters during 
the entire evaluation process. 



COORDINATOR 

The Cooi’dinator of the Field Services Division lias the responsibility for 
supervising the activities of the Field Services Division, and eoox'dinating its 
responsibilities with the Evaluation Services Division. Specifically, the Co- 
ordinator (1) responds to requests for service fi’om school districts and agen- 
cies, (2) assigns Field Service Representatives to each accepted program, (.") 
maintains frequent contact with all programs, (4) assists in the selection and 
training oi the staff, (5) periodically reports the progress of each program, 
and (6) assists in the fox'mulation and implementation of general policies and 
procedures of the EPIC Evaluation Center, 



REPRESENTATIVES 



The Field Service Representatives are assigned full responsibility for given 
programs, and this responsibility includes: (1) the initial interview and on- 

site survey (includes write-up), (2) developing a folder on each assigned pro- 
gi’am for the Field Sendees Division file, (!!) maintaining frequent contact 
(letter, telephone, personal visit) with assigned programs, (4) assisting in the 
data gathering, (5) collecting information which pi’ovides descriptive details con- 
cerning the participating students, teachers, school, and community, (G) con- 
tinual monitoring of program to provide for the actual pi’ogx’am description, (7) 
writing of program descriptions, and with the assistance of the Evaluation Ser- 
vices Division personnel, finalizing the program .vrite-up following completion 
of evaluation, (8) assisting the school district pei’sonnel in the recycling pro- 
cess: that is, making decisions for program changes or future evaluation, and 
(9) assisting in the development and implementation of EPIC workshops and in- 
service training activities. 

As evaluative programs are implemented, the Field Service Representative 
has two extremely important responsibilities, Fii'st, he advises and assists the 
program personnel in the collection of data necessary and inquired in the mu- 
tually accepted evaluation design. This implies that the monitoringprocedurcs 
employed by the Field Service Representative adhere to the predetermined pro- 
gram calendar. A second, and somewhat related responsibility, is that of as- 
sisting the program pei’sonnel to develop an "actual program" description as 
the instruction takes place. This enables the Field Service Representative to 
identify the variations in the actual program from the planned program in order 
to make the necessary adjustments in the evaluation process. It also provides 
the necessary’ information from which to draw conclusions and make decisions 
following the termination of a program. 
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The throe primary functions of the Evaluation Services Division are- m 
providing technical assistance for the selection of treatments measurement in 
s inxmonts, evaluation designs, and statistical analyses p, pwe^iTdita 
and (.1) reporting the results of the evaluation process. !ff Clata ’ 

it i 1 *' t 'f i8istanC0 5* vcn In the selection of treatment is, in most c~soq Mm 

5 

*’°, ,e ,® f thc Evaluation Services Division in the measurement process 
ensmo the appropriateness of measuring devices and nmcortntvic -r 
support this role, a file ot published and unpublished Instrume&s Is mihftalnoTl 

?,"£ '';„ t X ain ?, f 0,iabn “- V and "'formation on Iso tests t wK 

IL «nJt Vai nW . C ’ n ° ' Ver ’ m an.v programs have measurement needs for which 

Z5? n ] len | S ox,sl * In such cascs * the Personnel of the Evaluation Services 
Division devise or construct the necessary instruments. unices 

For a program to be evaluated, the process of selecting treatments mri 
!'vnln l, r' mC c devices delimits the general form of the evaluation design The 
- aluation Services Design Specialist then selects a specific evaluation design 
appropriate to the problems involved. It is within the framework of this Ho 

sign that tests, selected by a Measurement Specialist, determine whether or 
not the objectives of a program have been met. wnetner oi 

Depending on the particular evaluation design selected, the tests of tho »rn 
gram's objectives are based on several of the standard siatTstleal^ 



i 

ii 

( 

| * 



o 

ERIC 

hfiiiiiiiiiiTirfTiiaaa 



l 



wm 



9 



In most cases, the evaluation design dictates the statistic to be used. Further 
exploratory statistical analyses are often selected in addition to the planned 
tests of the objectives. Such exploratory analyses are selected in order to 
maximize the information available for input into future evaluations. Condi- 
tions which affect the functioning of a program frequently are not known and 
can only be discovered by means of exploratory statistical analyses. 

Before processing data, information concerning students, teachers, the 
school, and specific data related to each program is collected. Student and 
teacher identification numbers are assigned for each individual, to Identify him 
for as long as he is associated with the Evaluation Center, Test data col- 
lected by the Center is formated into the test data file, using a predetermined 
scheme. 

If possible, data is collected on test scoring answer sheets to be scored 
and punched automatically. When answer sheets cannot be used, the data is 
punched from the original test documents into data processing cards. 

After the data has been analyzed and compared to the program objectives, 
a written report of the results is preapred. This report provides school per- 
sonnel with feedback concerning the degree to which their program objectives 
have been met. 

This feedback is used to begin the recycling process, and those objectives 
which were not accomplished, along with new objectives, are considered for 
future or on-going evaluation. 

The Evaluation Services Division currently has a staff of ten pei’sons, four 
of whom hold advanced degrees in their respective fields. 



COORD’NATOR 



'Phc Coordinator of the Evaluation Services Division has the responsibility 
for supervising and coordinating all activities and programs with the field Sei- 
viecs Division, and maintaining liaison with the Director. In addition, the 
Coordinator (1) selects and classifies pei’sonncl, (2) assigns general and spe- 
cific responsibilities to the personnel in the Division, and (3) prepares and 
approves reports and materials for publication originating within the Division, 



SPECIALISTS 

The Evaluation Design Specialist is responsible to the Division Coordina- 
tor, His main responsibilities are to: (1) develop the evaluation designs for 

those programs undertaken by the EPIC Evaluation Center, (2) supervise the 
collection of pertinent research data for the purpose of evaluating selected in- 
structional programs, (3) provide statistical procedures and methods for the 
programs undergoing evaluation, and (4) assist in in-service ti’aining in stat- 
istical design and analysis, objective writing, and the use of evaluative instru- 
ments. 

There are two Measurement Specia lists directly responsible to the Coor- 
dinator. Their main duties are to: (li supervise the construction of scales, 
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questionnaires, and other such instruments as required for the evaluation of 
the programs, (2) compile and make available normative data, standardized and 
nonstandard zed tests for use in evaluation, and (3) assist with in-service train- 
ing on the local school level in the areas of statistical design and analysis, 
ojective writing, and the gathering and interpretation of normative data. 

The Daita Processing Manager , who is also responsible directly to the Co- 
f. r . d ,S or ° f .. the Div i?, ion ‘ plans and directs the activities of the data processing 
facuitj . His specific responsibilities are to: (1) develop and design cards, 

f»i?t?onin^f^ Gr pro S rams » and othc r materials necessary for the efficient 
functioning of the processing facility, (2) develop storage and classification sys- 
tems for collected information, (3) supervise the operation, scheduling, and 
use of all computer equipment in the data processing facility, and (4) assist 
with m-service training in the uses of computer equipment in the educational 



The Ev aluation Assistant is directly responsible to the Coordinator of the 
Division. His main responsibility is to assist Specialists in the development 
of evaluation design and statistical analysis procedures. In addition, he assists 
in any in-service training carried out at the local school level by the Center. 

The Machine and Keypunch Operators are directly responsible to the Data 
l rocessing Manager, who in turn assigns them specific duties in terms of the 
operation and use of the equipment. In addition, the machine and keypunch op- 
erators are responsible for maintaining all information and data files. 

The Division has two Programmers who are responsible to the Data Pro- 
cessing Manager. Their main responsibility is to write the computer programs 
necessarv for the processing of data collected for the evaluation of selected 
instructional programs. 



COMPUTER FACILITIES 



